Empirical Maximum Entropy Methods
نویسنده
چکیده
A method, which we suggest to call the Empirical Maximum Entropy method, is implicitly present at Maximum Entropy Empirical Likelihood method, as its special, non-parametric case. From this vantage point the entropy-based empirical approach to estimation is surveyed.
منابع مشابه
Maximum Probability and Relative Entropy Maximization. Bayesian Maximum Probability and Empirical Likelihood
Works, briefly surveyed here, are concerned with two basic methods: Maximum Probability and Bayesian Maximum Probability; as well as with their asymptotic instances: Relative Entropy Maximization and Maximum Non-parametric Likelihood. Parametric and empirical extensions of the latter methods – Empirical Maximum Maximum Entropy and Empirical Likelihood – are also mentioned. The methods are viewe...
متن کاملAn Alternative Method for Estimating and Simulating Maximum Entropy Densities
This paper proposes a method of estimating and simulating a maximum entropy distribution given moment conditions based on MonteCarlo approach. The method provides an simple alternative to conventional calculation methods of maximum entropy densities which involve complex numerical integration and are subject to occasional failure. We first show that maximum entropy density on a random sample co...
متن کاملToward An Empirical Evaluation of Maximum Entropy for Translation Modeling
I present empirical comparisons between a standard statistical translation model and an equivalent Maximum Entropy model. Results show that the Maximum Entropy model is promising, but highly sensitive to the method of feature selection.
متن کاملMaximum Entropy and Spectral Estimation
The temperature of a gas corresponds to the average kinetic energy of the molecules in the gas. What can we say about the distribution of velocities in the gas at a given temperature? We know from physics that this distribution is the maximum entropy distribution under the temperature constraint, otherwise known as the Maxwell-Boltzmann distribution. The maximum entropy distribution corresponds...
متن کاملDetermination of Maximum Bayesian Entropy Probability Distribution
In this paper, we consider the determination methods of maximum entropy multivariate distributions with given prior under the constraints, that the marginal distributions or the marginals and covariance matrix are prescribed. Next, some numerical solutions are considered for the cases of unavailable closed form of solutions. Finally, these methods are illustrated via some numerical examples.
متن کامل